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(57) A method for defining a color gradient across a 
region in a display space that includes defining a bi-cu- 
bic patch enclosing the region. The bi-cubic patch in- 
cludes four corners having a color associated therewith 
and four curves connecting pairs of the corners forming 
a closed loop. The four curves define the color gradient 
across the bi-cubic patch as a function of the four colors 
associated with the four corners of the bi-cubic patch. 
The method includes defining a unit square in parameter 
space including a mapping function from the unit square 
to the bi-cubic patch such that the corners of the bi-cubic 
patch map to the corners of the unit square. The color 
of every point in the unit square is a bi-cubic interpola- 
tion ol the tour colors associated with the four corners 
of the bi-cubic patch. The method includes clipping the 
bi-cubic patch for display of the region. In another as- 
pect, Ihe invention provides a melhod ol accurately ren- 
dering coloi gradients acioss a bi-cubic patch that in- 
cludes subdividing the bi-cubic patch into sub-patches 
until each side of a given sub-patch is a good approxi- 
mation of a line and checking to determine it for all points 
inside of a given sub-patch the color associated with 
each point is sufficiently accurate. If not, the sub-patch 
is further subdivided until the color associated with each 
point inside a given sub-patch is sufficiently accurate. 
The method includes dividing the sub-patches into pol- 
ygons and rendering the polygons 
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Description 

Background of the Invention 

The present invention relates generally to methods s 
and systems tor shading computer generated images 
and more particularly to methods and apparatus for 
shading objects for display on a display device. 

In many computer systems, it is common to repre- 
sent and convey information to a user through digital im- 
ages These images may take a variety of forms such 
as alphanumeric characters and graphs and other pic- 
torial representations. The digital images are conveyed 
to a users on a raster or continuous tone display devic- 
es, such as video monitors, printers and the like. Typi- 
cally, the digital images are stored in digital form, ma- 
nipulated and then displayed. 

Digital images are generally stored as a geometric 
description of a scene. The description can be manipu- 
lated by the user then converted to digital raster image 
ddta foi display. How a two or three dimensional object 
appears when it is displayed to a user depends on nu- 
merous factors including the types of light sources illu- 
minating it: its properties including color, texture and re- 
flectance: and its position and orientation with respect 
to the light sources, the viewer and other surfaces which 
may reflect light on the object. 

It IS often desirable to present objects for display in 
color In conventional practice, color may be applied to 
a regton by defining a single color for the entire region 
(a "flat" coloring), or to add realism, a plurality of colors 
mny be employed A transition between colors across 
the surface of an object is referred to as a color gradient. 
In order to display a realistic image, a smooth transition 
between colors across painted areas is required. Con- 
ventionally gradients have been created as pre-com- 
puiod digital images This technique leaves the user 
with limilod flexibility because the gradient has already 
boon rendered and modifications are limited. Alterna- 
tively gradients were defined as contours of constant 
color These types ol gradient also lack flexibility be- 
cfiuso the interpolation of colors in the gradient may be 
bivariale which is difficult to be represented with con- 
tours and the number ol contours used in the represen- 
tation IS device dependent. 

Summary 

In general in one aspect, the invention provides a 
method for defining a color gradient across a region In 
a display space that includes defining a bi-cubic patch 
enclosing the regton The bi-cubic patch includes four 
corners having a color associated therewith and four 
curves connecting pairs of the corners forming a closed 
loop The four curves define the color gradient across 
the bi-cubic patch as a function of the four colors asso- 
ciated with the four corners of the bi-cubic patch. The 
method includes defining a unit square in parameter 
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space including a mapping function from the unit square 
to the bi-cubic patch such that the corners of the bi-cubic 
patch map to the corners of the unit square. The color 
of every point in the unit square is a bi-cubic interpola- 
tion of the four colors associated with the four corners 
of the bi-cubic patch. The method includes clipping the 
bi-cubic patch for display of the region. 

In another aspect, the invention provides a method 
for approximating an existing color gradient associated 
with a first region in a display space for use in a second 
region in the display space. The method includes defin- 
ing a bi-cubic patch enclosing the second region, defin- 
ing a unit square in parameter space including a map- 
ping function from the unit square to the bi-cubic patch 
and manipulating one or more of the curves in the bi- 
cubic patch until the color gradient of the second region 
visually approximates a color gradient of the first region. 

In another aspect, the invention provides a method 
of accurately rendering color gradients across a bi-cubic 
patch that includes subdividing the bi-cubic patch into 
sub-patches until each side of a given sub-patch is a 
good approximation of a line and checking to determine 
if for all points inside of a given sub-patch the color as- 
sociated with each point is sufficiently accurate. If not, 
the sub-patch is further subdivided until the color asso- 
ciated with each point inside a given sub-patch is suffi- 
ciently accurate. The method includes dividing the sub- 
patches into polygons and rendering the polygons. 

Preferred embodiments include the following fea- 
tures. Rendering the polygons includes dividing the 
polygons into Gouraud triangles and rendering the 
Gouraud triangles. Each side of a given sub-patch is a 
good approximation when a lateral error between a side 
and its corresponding segment in display space is less 
than 0.5 pixels or a user-defined tolerance. The color for 
each point within a sub-patch is sufficiently accurate 
when control points associated with a sub-patch are 
evenly spaced. 

The method further includes checking to determine 
if for all points inside of a given polygon the color asso- 
ciated with each point is sufficiently accurate and. if not. 
further subdividing the polygon until the color associated 
with each point inside a given polygon is sufficiently ac- 
curate. The color for each point within a polygon is suf- 
ficiently accurate when the color of a center point in the 
polygon is within a predefined tolerance of a true color 
for the polygon. 

In another aspect, the invention provides a method 
of defining a color gradient across a region in a display 
space that includes defining a parametric bi-cubic patch 
covering a region to be shaded. Each patch includes 
four corners and four parametric cubic curves in a 
closed loop joining the four corners. Each corner has a 
corner color The method includes the step of perform- 
ing a bilinear interpolation on the corner colors to map 
an interpolated color to every location on the parametric 
bi-cubic patch. 

In another aspect, the invention provides a method 
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of interactively modifying an existing gradient to create 
a new gradient type that includes defining a parametnc 
bi-cubic patch covering a region to be shaded. Each 
patch includes four corners and four parametric cubic 
curves In a closed loop joining the tour corners. Each 
comer has a corner color. The method includes perform- 
ing a bilinear interpolation on the corner colors to map 
an interpolated color to every location on the parametric 
bi-cubic patch thereby defining a gradient, manipulating 
one or more of the cubic curves in the bi-cubic patch to 
change the gradient and displaying the bi-cubic patch 
interactively to the user. 

In another aspect, the invention provides a method 
of accurately rendering color gradients across a bi-cubic 
patch that includes subdividing the bi-cubic patch into 
sub-patches until each side of a sub-patch is a good ap- 
proximation o1 a line, then subdividing further until the 
interpolation within the sub-patch is linear within a spec- 
ified tolerance. The method includes subdividing the 
sub-patch into polygons and rendering the polygons. 

Preferred embodiments of the invention include the 
following features. The polygons are rendered with 
Gouraud shading. 

In another aspect, the invention provides a method 
for accurately rendering color gradients with Gouraud- 
shaded polygons that includes subdividing a gradient in- 
to quadrilateral regions in which a bilinear interpolation 
of colors associated with corners of quadrilateral region 
would render the gradient substantially The method in- 
cludes subdividing each quadrilateral so that Gouraud 
shading provides an accurate shading result within a 
specified tolerance. 

Preferred embodiments of the invention include the 
following features. A color space of the gradient Is non- 
linear with respect to a display device's color space and 
subdivision of quadrilateral regions continues until a 
plecewise linear approximation of a device color space 
interpolation is accurate to within a specified tolerance. 

In another aspect, the invention provides a method 
of rendering a non-linear color gradient using linear in- 
terpolation that includes defining a non-linear color func- 
tion and subdividing the color gradient into Gouraud 
shaded tnangles. Each triangle has a parameter asso- 
ciated with each vertex. The method includes using 
Gouraud-shading to linearly interpolate the parameter 
across a respective triangle. At each point on the trian- 
gle, an Interpolated parameter is used to evaluate the 
non-linear color function which provides a color value. 

The invention has numerous advantages. The con- 
cepts of three dimensional computer graphics rendering 
are applied to create two dimensional shaded objects. 
The present invention provides a smooth shading for an 
object in which a shading model is used to place color 
in a two dimensional region, while a color model Is used 
todefine the range of colors to be applied in the shading. 

Once a smooth shading is defined for a particular 
region, a user may easily adjust the shading and create 
complex color gradients for the filled region. 



Smooth shading has an additional benefit over con- 
ventional shading techniques because the gradients are 
rendered pixel by pixel on the given display device, they 
can include all of the colors the device Is capable of re- 
5 producing, and at the highest resolution possible. 

Other features and advantages of the invention will 
be apparent from the following description. Including the 
drawings, and from the claims. 



10 Brief Description of the Drawing 

FIG. 1 is a diagram of a display space of a raster 
display device for displaying digital Images. 

FIG. 2 is flow diagram of a method defining a 
15 smooth shading over a region according to the inven- 
tion. . 

FIG. 3 shows a radial shading according to the in- 
vention. 

FIG. 4 shows an alternative radial shading accord- 
20 ing to the invention. 

FIG. 5 shows axial shading according to the inven- 
tion ^ . 
FIG. 6 shows a triangle mesh shading according to 

the invention. 

25 FIG. 7 is a schematic of a patch mesh according to 
the invention. 

FIG. 8 is a flow diagram for shading a region ac- 
cording to the invention. 

FIG. 9 Is a flow diagram for a method of rendering 
30 a patch according to the Invention. 

FIG. 10 Is a block diagram of a programmable in- 
formation processing system according to the Invention. 



35 Detailed Description 

With reference to FIG. 1 . a two-dimensional object 
100 displayed in a display space 102 is shown. Object 
100 defines a region 104 of arbitrary shape and size. A 
40 two-dimensional shading of region 1 04 Is defined includ- 
ing a shading model and a color model. The shading 
model defines the geometric shading of region 104. In 
one embodiment, the shading model is defined to be in 
the shape of a circle 106 (a "radial shading") with a ra- 
45 dius r. defining a region 108. The color model defines 
the color range for points within region 108. The color 
model associated with radial shading 106 includes start- 
ing and ending colors and Cj. The color at every point 
within the region 108 is defined by a combination of the 
so shading model and the color model as an interpolation 
of colors ci and Ca along all radii of circle 106. Once 
defined, only the intersection of regions 108 and 104 is 
displayed in a raster imago for region 108. In this way, 
an artist (user) can fill a region whose shape is inde- 
55 pendent of the shape defined by the shading model. 

With reference to FIG. 2, In a method of defining a 
color gradient for achieving smooth shading across a 
filled area, a shading model is defined (100). The shad- 
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ing model specifies the geometry of a color gradient. 
Shading models include radial, axial, function shading, 
triangle mesh shading and patch mesh shad.rjg^ 

With reference to FIG. 3, an example o a radial 
shading 200 for region 104 is shown. A radial shad.rig 
^ay be in the shape of a circle, ellipse, or polygon^ In 
addition, a radial shading may define the shading for the 
area between two boundary elements having he same 
Jhape Where the shape may be a circle, an eUipse or a 
polygon. For example, a radial shading "^^V "^f ^ 
shading for a disc or an annulus region. In this type of 
shSir.gmodel.the boundary elementsneed not becen^ 
tered on the same point. A color gradient may be defied 
between the center and the periphery by ^ color mod^j- 
A color model defines the transition from the color des- 
lanated for the center to the color designated for the pe- 
rSiery A color model associated with a radial shading 
Includes a color defined for a centroid 202 (in this case 
the center of the circle, but the centroid may be o«se^ 
,rom the center in some applications) and the penphery 
204 in a radial shading, the color lor all angles 6 is a 
function of the proportional radius r (distance from the 
centroid). In the particular example of FIG. 3 where the 
centroid is at the center of circle 200. any two points at 
tho same proportional distance rfrom the center (such 
as points XI and X2) will have the same color 

A radial shading lor the region 104 may also be in 
the shape of an annulus, i.e., the area between concen- 
tric circles (FIG. 4). In this type of radial ff "9. a gra- 
dient m.y be defined from the outside of a fj^^t c.cle to 
the inside of the second circle by a color mode • A color 
Tdef^ed lor each circle, the color model defines the 
transition between the two colors 

Referring now to FIG, 5, an axial shading for the 
region 104 is shown. A axial shading is in the shape of 
a Sne 300. The line includes a start point 302 and an 
end point 304 The start point and the end point each 
have an associated color A color model may define the 
nradient between the start and the end point 

A function shading is defined almost entirely by its 
associated color model A function shading merely pro- 
vides a bounding box in which a two dimensional color 
function, defined by a color model, is rendered. Typical- 
ly, the color function is a sampled tunction in which the 
sample values are interpolated to fill the bounding box 
Lined by the shading model An example of a unc ion 
Which can be used is a bivariate polynomial tunction. 
where lor each point (x.y) in the bounding box the pol- 
ynomial is evaluated to obtain a color value^ 

Referring now to FIG. 6, a triangle mesh shading is 
defined by a collection of triangle vertex coordinates, 
with a color defined at each vertex. The colors are inter- 
polated within the triangles using Gouraud shading 1" 
this technique, t.he color model defines the colors at the 
coordinates and the interpolation of color values _and 
the shading model is Gouraud shading. The effect of his 
type of shading model is to produce an approximation 
of bilinear interpolation of the color values at the verti- 



ces This method can be used to render 3D scenes. A 
triangle mesh shading can also be used to interpolate 
parameter values which are used as inputs to functions 
defined by the color model. Instead of specifying colors 
s at the vertices, the color model specifies a single param- 
eter value at each vertex, and a color function of one 
parameter for the whole triangle. When the triangle is 
rendered, the parameter values are '"terpolated and 
passed to the color function, which returns a co'°; valu« 
,0 LthecorrespondingparametervalueThecoorr^o^^^ 
is used to create a two-dimensional shading for aesthet 

•^"r~"shading may be used to describe a 
non-linear cotor gradient over a region. A P^Jc^. m«^^^^^^ 
,5 a collection of adjoining patches. For P^^^"^ P"^f^^^^^^^ 
a patch is defined as a two-dimensional P^rameUic sur 
face. For example, a tensor product surface r^ay be 
mapped from a two-dimensional unit square to a three 
dimensional surface bounded by 4 curves. In one ern^ 
20 bodlment o( the invention, smooth shading Patches are 
defined which provide mappings from a unit square to 
a two-dimensional region bounded by 4 curves. A colo 
model defines the colors at the comers o the unit 
square. An implicit color function bilinearty interpolates 
2B the corner colors across the unit square. Since eve^ 
point in the unit squareismappedtoapoininthepa^ch^ 

a gradient is also defined by the mapping from interpo 
lated colors on the unit square to points wi hin the re- 
gion AS with triangle mesh shading, the colors can be 
30 Replaced with parameter values, and the .nte^ed 
parameters passed to a color function which provdes 
L actual color Patches are described in greater detail 

below in reference to FIG. 7. 

Referring again to FIG. 2. after a shading model is 
35 defined, then a color model is defined which includes a 
color range and may include a color tunction unless « 
is implicitly defined in the shading "^^^el (102 . The 
color function defines how a given coordinate in the 
shading model maps to a particular color. For example, 
.0 anexponentialfunctionmaybeselectedforthefunction^ 
Alternatively, the shading model selected 'n step 100 
rr^ay include an implicit mapping function. As described 
above, a patch mesh includes an implicit mapping func- 

45 The shading model and associated color model are 
stored in memory (104). At the time lor display the ob- 
ject to be displayed and its associated shading model 
and color model are retrieved from memory and the ob- 
iect is rendered. The shading and object may be subject 
so o coordinate space transformations, These transforms 
may be made prior to rendering. Typically^m a 2D ren 
derlg environment these are limited to aff.ne transfor^ 
mations. Since the shading is subject to coordinate 
urnsformations. the user can define transformations to 
55 change the appearance of the gradient - scaling, skew- 
ing roiling, and soon. Finally, thedigital image includ- 
ir^g shading is presented for display on a raster scan de- 
vice (110). 
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firadients and Functions 

AS mentioned previously, gradients are created in 
the invention by defining a shading model and a color 
model The shading model defines the geometry - where 
to place the colors, and how they change spatially 
across the region. The color model defines the range of 
colors to be displayed and a color function which deter- 
mines color values to be used within the region^ The 
separation between shading model and color model al- 
lows the user to mix various shading models and color 
models to produce new gradients from a set of pre-de- 
fined shading models and color models. 

Interacting with a system through a graphical user 
interface, for example, a user may select from a range 
ol pre-defined shading models and color models. The 
shading models include axial, radial, function shading, 
triangle mesh, and patch mesh, as described above^ 
The user also selects from a set of color functions which 
include sampled functions, exponential inlerpolalion, 
stitching functions, and bivariate polynomial functions. 

Sample functions consist of a one or two-dimen- 
sional array of sample values. In building an array, the 
values of the samples may be chosen freely. For exam- 
ple they could bo generated by sampling a mathemat- 
ical function at regular intervals, or even a digital repre- 
sentation of a natural image. All functions must provide 
a color value for any value within the function's domain. 
Domains must be continuous, therefore the sample 
function must interpolate color values between sam- 
ples. Linear and cubic spline interpolation may be in- 
cluded in the function. 

The exponential interpolation function takes a start- 
ing and ending value and returns a color value by inter- 
polating between the starting and ending values^ The 
interpolation is exponential, and the user can specify the 
exponent value. Multiple component color values may 
be interpolated on a per-component basis. 

The stitching function combines an array of arbitrary 
functions and 'stitches" them together within a shading 
model. The functions it can stitch together include all of 
the one-input functions, including itself. 

The bivariate polynomial function is a way for the 
user to create a bivariate polynomial of degree n, where 
n IS a constant. By specifying all of the coefficients of an 
n degree polynomial, the user can specify any bivariate 
polynomial of degree n. One can consider the bivariate 
polynomial function as an implicit function where con- 
tinuously changing values are returned in areas outside 
of where the function is zero, sometimes referred to as 
the "gauge space" of the function. 

As an example of the shading model and color mod- 
el interaction, consider a radial gradient (shading) with 
an exponential interpolation function. The radial shading 
may for example, define a shading between two circles, 
a small inner circle and a larger concentric outer circle. 
As part of the color model, starting and ending colors 
are provided as well as a color function. An exponential 



Interpolation function has one input function. Here, the 
input values correspond to positions along the radius 
between the two circles. This is the domain of the color 
function, and we can define it to be from 0 to 1. The 
5 radial shading model will map values within the region 
to be shaded to distances along the radii. In this exam- 
ple points on the smaller inner circle will map to zero 
while points on the larger outer circle will map to one^ 
Points in between will map to values between zero and 
70 one Thus for every point within the region, a mapping 
is made to the distance along the radius, scaled to val- 
ues between 0 and f . This distance is a parameter value 
("t" ) which is passed to the exponential interpolation 
function "s(t)". The function interpolates between the 
15 starting and ending colors, using t as the parameter of 
interpolation to return a color value for the given loca- 
tion Note that the user could have just as easily re- 
placed the exponential interpolation function with a one 
input sampled function in which case the parameter t 
20 would then be used as a position within the sample ar- 
ray and a color would be returned based on a sample 
value. In this example, interpolation is used if t is be- 
tween two sample values. 



25 Patch Shading 

Referring to FIG. 7. smooth shading across a filled 
area 502 may be accomplished with the use of a bi-cubic 
patch 506 Bi-cubic patches have been used in the prior 
30 art to represent three-dimensional geometry A bi-cubic 
patch is a parametric surface bounded by cubic curves 
(CI C2 D1 D2) Two types of bi-cubic patches may be 
used a Coons patch bounded by cubic Bezier curves 
(hereinafter a "Coons patch"), and a bi-cubic tensor 
35 product surface ("tensor product patch"). The Coons 
patch can be converted easily to a tensor product sur- 
face so all patches are effectively tensor product sur- 
faces even though the system may allow a Coons patch 
to be specified. A tensor product patch is a mapping 
40 from a unit square 500 to a patch 506 bounded by four 
cubic cun/es. with four additional curves defining the ar- 
ea of the patch within the boundary cun/es. Typically in 
3-dimensional (3D) implementations the curves are 3D 
cun/es For the creation of gradients, two-dimensional 
45 cun/es are used. Corners 504 of the unit square map to 
comers 508 of tensor product patch 506. Similarly, the 
four edges 510 of the unit square map to the tour edges 
512 of the tensor product patch 506. Also, every point 
within unit square 500 maps to a point on the surface 
so (tensor product patch) 506. 

The mapping may be defined by a pair of parametric 
functions, one for each dimension. If u and v are the 
parameters corresponding to the two axes of unit square 
500 than a function X(u,v) maps points on unit square 
55 500 to X coordinate values on tensor product patch 506. 
A second function. Y(u, v) maps each point on the unit 
square (u.v) to y coordinates on the tensor product 
patch 506. Therefore, each point on the tensor product 
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surface is defined as (x. y) = (X(u,v). Y(u,v)). Spec,^- 
Jally for a bi-cubic Bezier patch, which .s a surface de^ 
Sed with a cubic Bezier curves, the functions are of the 
form: 

S(u,v) = x'i^2VoPiiBi(u)Bj(v) 

where P • is the control point lor row i, column j. of the 
Beztr Sntrol net, and B,(u) and are the Bernstein 
polynomials for u and v: 



B,(t) = 3t(1 -t)' 



B2(t) = 3t^ (1 -t) 



B3(t)=t 



TO specify a gradient, the user defines colors at the 
four corners 508 of the of the patch, or equivalently. the 
four corners 504 of the unit square The user then de- 
fines the control points of the surf ace. As men^oned pre- 
viously, a mapping is defined for every point on the unrt 
square to a point on the surface (patch). Thereafter, the 
comer colors are billnearly interpolating over the unrt 
square, which then gets mapped to a gradient in the 
Sape of the patch. Once the four comer co ore have 
hoen defined, the user can then manipulate the patch 
curves to get whatever gradient is desired. 

The changes in color within the gradient are affect- 
ed by the geometry ol the patch. For example, a square 
patch will display a simple bilinear ^^^^^f^^^^^''^^^ ^^ 
comer colors. If the left and right curves are made to 
::rinward at the middle, then the colors o the grad. 
ent will be squeezed in the middle and Ian out at the top 
and bottom Thus, changes in the curves intuitively de- 
fine changes in the gradient. 

The user may specify patch curves that cause a 
-foldover" condition. A loldover is when multiple points 
on the unit square map to one location in the patch. A 
simple painter s algorithm can be used to delemiine the 
visible parts of the surface. Foldovers can be used to 
create special effects that resemble 3D geometry. Wrth 
appropriate choice of corner colors, a convincing result 
can be produced. 

the patch 506 can be defined to include a given re- 
aion 502 When the gradient is rendered only the inter- 
Ttion of L regionlnd the patch will be filled (by clip- 
ping to the region). 

The principles ol single patch gradients can be ap- 
pliedtopatch meshes. Apatch mesh isa set of patches 
with shared edges. Each patch in the mesh has an as- 



sociated mesh of unit squares with equivalent topology 
Each unit square has 4 comer colors. Shared edges 
Share corner colors. Each unit square f "^^^^^'""^^^ 
interpolation of the lour comer colors which gets 
5 mapped to the corresponding bi-cubic patch. A patch 
meS allows the user to create a more complex geom- 
etry in the gradient as well as allowing more colors to 

''Tswrtrianglemeshes.thecolorsofthe patch can 
,0 bereplaced with parameter values, in which caseacoior 
function needs to be specified. In this example^ four pa- 
rameter values are specified at ^^^^^^"^^^^ °' J^J^^J 
square A bilinear interpolation is perfomied on the four 
p^^meter values to produce a single parameter °r 
,5 each point on the unit square, and equivalently on the 
SJch Xhen the patch is rendered, the parameter value 
fpTssed to the color function which returns an actual 

''°'°Referhng to FIG. 8, in a method for defining a color 
,0 gradient across the region in a ^ispiay space, a t«-cub c 
^tch is defined enclosing the region (550). Cotors a^e 
selected and associated with the four corners of the bi 
cubic pitch (552). Thereafter, a unit square in parameter 
space is defined associated with the bi-ub.c Pa^j^ 
2S (554). The unit square is mapped to the t>-cubic patch 
such that each point in the unit square maps to at least 
o^e pl'.nt in the bi-cubic patch wherein the color of every 
point in the unit square is a bilinear '"'-^P°'«*'°" ° 
Lrcomer colors associated with the four corners of he 
so bi-cubic patch. The user thereafter defines control 
Doints for the bi-cubic patch (556). In one example, the 
S^tS. points may be four Bezier cun^es which de ine 
tl^Sorgradient across thebi-cubk: patch asafuncmn 

of the four colors associated with the four corners. The 
35 coloroftheregionmaythereatterbeselected^^^^^^ 
ulating the control points associated wrth the bi-cubic 
patch to create the desired shading (558). 



40 



Visual Approximation 



The use of bi-cubic patches to define color gradi _ 
ents allows for complex color gradients to be specified 
Sy For example, the Bezier curves associated with 
me coons patches are easily manipulated to vary a 
.5 Sor gradient over a tilled area One advantage of the 
use ofbi-cubic patches to define color gradients is the 
intui°vechangesincolorassociatedwithinteractivenna^ 

nipulation of The Bezier curves. Stretching one of the 
boundary cuives will result in stretching the gradient in 
so r saml direction. This allows users toJnterac.ve^y 
create gradients for various special effects. For exarr. 
p rthe user can make the gradient blend four separ Je 
shapes together by making the boundary curves matoh 
the given Lpes. More shapes and colors can be blend- 
55 ed by using a patch mesh, resulting in a combination of 

"^ttZ^^ want to match an existing gra- 
dienrVhis can be accomplished by logically dividing an 
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existing gradient in to patches and defining a corre- 
sponding patch rr^esh. For exannple. a type of gradien 
known as a -conical" gradient is a circu ar or emptical 
shaped gradient where the interpolation follows the cir- 
cumference of the circle. A visually equivalent conical 
gradient can be produced by specifying four Coons 
patches in a mesh. 

Each patch in the mesh is one quarter of the circle. 
Each patch uses one of its cun/es for the circumference 
of the circle, and two of its curves for radii o the circle_ 
The fourth curve is degenerate, i.e. it is zero length and 
represents the center of the circle. Thus, each patch in 
the mesh is shaped like a slice of a pie. The corner colors 
are defined so that the comers on the circumference are 
equal to the interpolated colors along the circumference. 
The comers at the center are set to the same colors as 
the corresponding circumference corners. Visua y. the 
gradient looks the same as a conical gradient. Allowing 
This type of gradient matching makes for a smaller inter- 
lace, instead of trying lo define every possible grad.enl 
in the interface, the system provides the user tools to 
create an infinite variety of gradients. 

Rendering 



Rendering is the process of creating images from 
the stored digital information (shading model and color 
model which may take the form of a bi-cub,c patch). 
Rendering of gradients made up of one or -^o^^ P^'^^^^ 
is a two step process. The first step is to subdivide the 
gradient into sub-patches. The second step is to divide 
the sub-patches into polygons and then render the pol- 
ygons, in the case of sub-patches, an adaptive subdivi- 
sion technique is used. 

Adaptive subdivision works by recursively dividing 
a patch into smaller and smaller sub-patches until the 
patch curves are sufficiently flat that the sub-patches 
can be approximated as polygons. While flatness is an 
adequate criterion lor terminating subdivision when 
generating 3D geometry, it is not sufficient for generat- 
ing smoothly shaded gradients. ^ , , „ ^ 
Consider the case of a Coons patch shaped like a 
square The beginning and ending control points of each 
curve are coincident with comers of the square. A non- 
linear interpolation can be defined by moving the two 
control points cf the left and right curves which are not 
comer control points to the bottom of the curves The 
curves are still sliaight lines, but the interpolation is no 
linea, If the implementation used only flatness as a test 
for stopping subdivision, then it would stop without any 
subdividing because the sides of the patch are already 
flat This would cause a square polygon to be rendered 
with Gouraud shading, producing a linear interpolation, 
which was not intended. 

Accordingly, the system includes a linearity check 
tomakesurethe sub-patch is not only geometncallyflat. 
but also linear in its interpolation After a curve in a sub- 
patch is determined to be flat, a lest for linearity is per- 



formed For example, the linearity test may look at the 
distances between control points of the patch and the 
colors at the endpoints of the Bezier cun/e (corner colors 
of the patch or sub-patch). The colors at the two control 
5 points between the endpoints of a respective curve are 
computed and compared to the colors that would have 
occurred at equal thirds along the path using a linear 
interpolation. If the colors values are within a spec, led 
tolerance, the patch is then assumed to be linear within 
10 the tolerance, and subdivision of patches can stop. 

For the purposes of this discussion, this tolerance 
is called the "smoothness". Smoothness plays an im- 
portant role in specifying how accurate the colors in a 
qradlent are. The smoothness criterion allows the user 
75 to fine tune the rendering performance, with a speed 
versus quality trade-off, similar to the flatness tolerance 

^ln°g'^neral. smoothness is the tolerance for color ac- 
curacy. It may be defined as a real number from 0 to 1 . 
20 where 0 represents an allowable error of 0% and 1 rep- 
resents an allowable error of 100%. As an example, a 
display device may be able to represent 256 levels of 
each color component red. green, and blue. If the 
smoothness value is .01 . then each color component is 
25 allowed to bo no more than 2 color levels greater or less- 
er than the exact value. ..^ • „ 
smoothness not only applies to patch subdivision. 
It is also used for subdivision of polygons used by other 
types of shadings. For example, function shading when 
30 used with a sampled function is implemented by creat^ 
ing a mesh of quadrilaterals, where associated with 
each comer of the quadrilaterals is a sample color value. 
By dividing the quadrilaterals into triangles and render- 
ing them with Gouraud shading, an approximation of bi- 
35 linear interpolation can be done. What is desired how- 
ever is exact bilinear interpolation. Accordingly, further 
subdivision of the quadrilaterals is done until the approx- 
imation is within the smoothness tolerance. In this ex- 
ample, a test for smoothness is made by checking to 
40 determine for all points inside of a given polygon wheth- 
er the color associated with each point is sufliciently ac- 
curate If not, further subdividing of the quadrilateral is 
performed. In one embodiment, the color for each point 
within a quadrilateral is detemiined to be suft.c.en ly ac- 
.5 cLxe When the color of a center point in a quadrilateral 
is Within a predefined tolerance of a true color for the 

quadrilateral. . , 

Another use of the smoothness tolerance is to pre- 
vent inaccuracies in color conversion. Colors in a color 
so model specification are given in a particular color space^ 
Color spaces are sets of color components that can be 
combined tocreate any cotor in the color space s gamut. 
For example, red. groon, blue (RGB) is a color spaco_ 
so is the set of colors cyan, magenta, yeltow. and black 
ss (CMYK). In addition to these device dependent color 
spaces there are device independent color spaces such 
as CIE L*a*b' in which colors are specified according to 
an international standard rather than percentages of 
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phosphor intensity (RGB) or ink (C^^K) wh.ch are .n- 
Serently device dependent. It a color model for a shad- 
es Ipecified in a color space dmerentthan the d^^e. 

he conversion is often non-linear. To accurately epre- 
sent an interpolation when the conversion .s non-l.near 
the interpolation can be done in the specified colo 
space, and then converted to the dest.nat.on co^r 
space This however, is costly on devices such as high 
rLoTution printers because the number of pixels to con- 

^^';;roid mfs performance cost, the system, when 
rendering quadrilaterals, interpolates in the device s 
color space by converting just the comer colors. To 
mStain accuracy, the quadrilaterals are subd^.ded 
enough so that a piecewise linear interpolation approx- 
fmates the non-l.near conversion with.n a 9'ven to^er- 
a^e in one embodiment, this tolerance is the smooth- 
ness tolerance. When subdividing, asamplingof the ex- 
act interpolation (with conversion) at ^'^^ious points j 
performed lo see ,1 a linear approx.malK,n 's w.th.n o - 
erance If so. subdivision can stop. The smoothness tol- 
erance is used as an upper bound on all color approx.- 
mations allowing the user to have control over qualrty 
Versus performance with a simple, easy to understand 

'"'°?urther subdivision of patches and sub-patches 
may be required after the linear approximation test js 
satisfied in the initial color space to assure a 'n^a-- ap- 
proximation after conversion to a device color -pace 
one type of shading model described above .s a Gour- 
aud-shaded triangle mesh shading. In this type of shad- 
ing model, if the color space of the specified colors s 
Sar With respect to the display device's color space^ 

e the conversion from the spec.f.ed color to the de 
vice's representation is linear), then the triangles can be 
rendered as-,s with Gouraud shad.ng techniques. II the 
color space conversion is not linear, then the tnang es 
are subdivided further so that linear approximation of the 
non-linear conversion can be accomplished. 

Referring to FIG 9, in a simple methodfor rendering 
a bi-cub.c patch, a rendering engine receives a patch to 
be rendered (600), The patch is divided .nto sub-patch- 
es (602). The sub-patches are checked to deternn.ne , 
theirflaJness (each s.de be.ng a good aPP-x--at^;^ 
a l,ne) .s w.th.n a predefined tolerance (604), The lal 
ness est is a geometric constraint which requ.res that 
me sSpatct. must be within a predefined flatness tol- 
erance When mapped back to a unit square, Typi^ly. 
the tolera.ice used is one half pixel. Alternatively the us- 
er mav set the tolerance level. 

lUheflatnesstestfailsforasub-patch.thenthesub- 

patch is subdivided (606). The flatness test is repea ed 
(or each sub-patch (610), If the flatness test .s sa sf.od 
for all the sub-patches (61 2) then the process cont.nues 
at step 614, Otherwise, any non-flat sub-patches are 
subdivided again at step 606. In one embod.rinent. a 
depm first recursive process is usedtofurther subd.v.de 
the sub-patches. 



After all of the sub-patches have passed the flat- 
ness test a check is made to determine whether or not 
the each sub-patch is linearly accurate (614). Thel.ne 
arrty is checked by determining the ^'Stances be^«een 
5 control points and the colors at the endpoints of the Bez- 
ier curves associated with the patch (corner colors of 
he sub-patch). Colorsat the two control pointsbetween 

he endpoints Of the curve are computed and compared 
to those color values that would have occurred at equal 
10 thirds along the path using linear ^rpotetion^ H the 
colors values are within a specified tolerance, the patch 
is then assumed to be linear within a tolerance, and sub- 

division can stop. «:^;^„th# 
„ the linearity lor any sub-patch .s not suff.c.en ly 
15 accurate (61 6), then each of these "poor color l.nearrty 
subStches is subdivided again (618). Thereafter the 
each new sub-patch .s checked (620) When 
L linearity for all sub-patches is suffic.erntly accurate, 
then the sub-patches are divided into polygons (622). 
20 Thereafter a linearity check may be performed on the 
poVgons by checking to assure the color for all po.r^ts 
She polygon is a good approximation of a true color 
Ls described above. Finally, the Po'VS-- f-J'.^'^^J 
into Gouraud shaded triangles and are rendered (623). 
25 Thereafter, the process ends (624). ^ 

The invention may be implemented .n hardware, 
firmware or software, or a combination of the three. Pref- 
e^bly the invention is implemented in a computer pro- 
gram executed on a programmable computer having a 
30 procession, a data storage system, volat.le and non-vol- 
atilememory and/or storage elements, at least one .nput 
devicTand at least one output device. The programma- 
b^cinputer may be part of a printer which recedes 
shading model and color model informa^on and exe- 
35 cuSsthemethodsdisclosedhereintoproducesmooth- 
^, lhaded regions on a visual or hard copy d.splay con- 
nected to (or at) the output device. 

S way of example, FIG. 10 shows a block d.agram 
of a programmable information processing system 
.0 icomputer) 10. Computer 1 0 preferably includes a proc 
issor 20, random access memory (RAM) 21 a program 
memory 22 (preferably a writable read-only memon, 
TroM) such as a flash ROM) and an input/outpu ( /O) 
oSroller 24 coupled by a CPU bus 25. Com^^^^^^^ 
45 mav optionally include a hard drive controller 23 which 
TcoupL to a hard disk 30 and CPU bus 25. Hard d.sk 
30 may be used tor storing application prograrns. such 
S the present invention, and data. AltemaUveJ,. appli- 
cation programs may be stored in BAM or ROM. 
so I/O controller 24 is coupled by means of an I/O bus 
26 to an I/O interface 27. I/O interface 27 receives and 
transmits data in analog or digital 'f^'" ,°^«^J=°~ 
cation links such as a serial link, loca area network. 
Wireless link, and parallel link. Optionally, a display 23^ 
55 a keyboard 29 and a pointing device (mouse) 31 may 
Lo be connected to I/O bus 26 Alternatively separate 
connections (separate buses) may "e "sed tor I/O in^ 
terface 27. display 2B. keyboard 29 and pointing devKie 



8 



BNSDOCID <EP 087281 1A2 1 > 



15 



EP 0 872 811 A2 



30 Programmable processing system 10 may be pre- 
programmed or it may be programmed (and repro- 
grammed) by downloading a program 1^°"^^"°^^^^ 
Lurce (e.g., a floppy disk. CD-ROM. or another com- 

^"^%ach computer program is tangibly stored in a ma- 
chine-readable storage media or device (e.g., program 
memory 22 or magnetic disk) readable by a general or 
special purpose programmable computer, for configur- 
ing and controlling operation of a computer when the 
storage media or device is read by the computer to per- 
tm xue procedures described herein. The .nvent.ve 
system may also be considered to be embodied in a 
computer-readable storage medium, configured wrth a 
computer program, where the storage medium so con- 
„gured causes a computer to operate in a specific and 
predefined manner lo perform the functions described 

The present invention has been described in terms 
ol specific embodiments, which are illustrative ol the in- 
vention and not to be construed as limiting. Other em- 
bodiments are within the scope of the following claims. 



Claims 



1 A method of defining a color gradient across a re- 
gion in a display space comprising the steps of. 

defining a bi-cubic patch enclosing the region, 
the bi-cubic patch includingfour comers having 
a color associated therewith and four curves 
connecting pairs of the comers forming a 
closed loop the tour curves defining the color 
gradient across the bi-cubic patch as a function 
of the four colors associated with the four cor- 
ners of the bi-cubic patch; 
defining a unit square in parameter space in- 
cluding a mapping function from the unrt square 
to the bi-cubic patch such that the comers of 
the bi-cubic patch map to the comers of the unit 
square and wherein the color of every point in 
the uni t square is a bi-cubic interpolation of the 
lour colors associated with the four comers of 
the bi-cubic patch: and 

clipping the bi-cubic patch for display of the re- 
gion. 

2 A method of approximating an existing color gradi- 
ent associated with a first region in a display space 
for use in a second region in the display space com- 
prising the steps of: 

defining a bi-cubic patch enclosing the second 
region, the bi-cubic patch includingfourcomers 
having a color associated therewith and four 
curves connecting pairs of the comers forming 
a closed loop, the four curves defining the color 



16 

gradient across the bi-cubic patch as a function 
of the four coicrs associated with the four cor- 
ners of the bi-cubic patch; 
defining a unit square in parameter space in- 

5 eluding a mapping function from the unit square 

to the bi-cubic patch such that the comers of 
the bi-cubic patch map lo the corners of the unit 
square and wherein the color of every point in 
the unit square is a bi-cubic interpolation of the 

10 four colors associated with the four comers of 

the bi-cubic patch; and 

manipulating one or more of the cun/es in the 
bi-cubic patch until the color gradient of the sec- 
ond region visually approximates a color gradi- 
75 ent of the first region. 

3 A method of accurately rendering color gradients 
across a bi-cubic patch comprising the steps of: 

20 subdividing the bi-cubic palch into sub-patches 

until each side of a given sub-patch is a good 
approximation cf a line; 

checking to determine if for all points inside of 
a given sub-patch the color associated with 
OS each point is sufficiently accurate and. if not. 

further subdividing the sub-patch until the color 
associated with each point inside a given sub- 
patch is sufficiently accurate; 
dividing the sub-patches into polygons; and 
30 rendering the polygons. 

4 The method of claim 3 wherein the step of rendering 
the polygons includes the steps of dividing the pol- 
ygons into Gouraud triangles and rendering the 

35 Gouraud triangles. 

5 The method of claim 3 wherein each side oi a given 
sub-patch is a good approximation when a lateral 
error between a side and its corresponding seg- 

40 ment in display space is less than 0.5 pixels. 

6 The method of claim 3 wherein each side ol a given 
sub-patch is a good approximation when a lateral 
error between a side and its corresponding seg- 

4S ment in display space is less than a user-definable 
tolerance. 

7 The method of claim 3 wherein the color (or each 
point within a sub-patch is sufficiently accurate 

so when control points associated with a sub-patch are 
evenly spaced. 

8 The method of claim 3 further including the stop of 
checking to determine if for all points inside of a giv- 

55 en polygon the color associated with each point is 
sufficiently accurate and. if not, further subdividing 
the polygon until the color associated with each 
point inside a given polygon is sufficiently accurate. 
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9 The method of claim 8 wherein the color for each 
■ poir^t within a polygorf is sufficiently accurate when 

the color of a center point in the polygon is wrthin a 
predefined tolerance of a true color for the polygon. 

10 A method of defining a color gradient across a re- 
■ gion in a display space comprising the steps of: 

defining a parametric bi-cubic patch covering a 
region to be shaded, each patch including four 
corners and four parametric cubic curves in a 
closed loop joining the four corners, each cor- 
ner having a comer color; 
performing a bilinear interpolation on the corner 
colors to map an interpolated color to every lo- 
cation on the parametric bi-cubic patch. 

1 1 A method oi interactively modifying an existing gra- 
■ dient to create a new gradient type comprising the 

sleps ot: 

defining a parametric bi-cubic patch covering a 
region to be shaded, each patch including four 
comers and four parametric cubic curves in a 
closed loop joining tho four corners, each cor- 
ner having a corner color; 
performing a bilinear interpolation on the corner 
colors to map an interpolated color to every lo- 
cation on the parametric bi-cubic patch thereby 
defining a gradient; 

manipulating one or more of the cubic curves 
in the bi-cubic patch to change the gradient: 

Slaying the bicubic patch interactively to the 
user. 

12 A method ol accurately rendering color gradients 
across a bi-cubic patch comprising the steps of. 

subdividing the bi-cubic patch into sub-patches 
until each side of a sub-patch is a good approx- 
imation of a line, then subdividing further until 
the interpolation within the sub-patch is linear 
within a specified tolerance; 
subdividing the sub-patch into polygons; and 
rendering the polygons. 

1 3. The method ol claim 1 2 where the polygons are ren- 
dered with Gouraud shading. 



and ^ . 

subdividing each quadrilateral so that Gouraud 
shading provides an accurate shading result 
within a specified tolerance. 

15 The method of claim 14 wherein a color space of 
the gradient is non-linear with respect to a display 
device's color space, and subdivision of quadrilat- 
eral regions continues until a piecewise linear ap- 
proximation of a device color space interpolation is 
accurate to within a specified tolerance. 

16 A method of rendering a non-linear color gradient 
using linear interpolation comprising the steps ot. 

defining a non-linear color function with one in- 
put parameter; 

subdividing the color gradient into Gouraud 
shaded triangles, each triangle having a pa- 
rameter value associated with each vertex; 
using Gouraud-shading to linearly interpolate 
parameter values across a respective triangle; 
at each point on the triangle, using an interpo- 
lated parameter value to evaluate the non-lin- 
ear color function which provides a color value. 

17 A computer program, tangibly stored on a compu- 
■ ter-readable medium, comprising instructions for 
causing a computer to: 
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14 A- method of accurately rendering color gradients 
■ with Gouraud-shaded polygons comprising the 
stops of: 

subdividing a gradient into quadrilateral re- 
gions in which a bilinear interpolation of colors 
associated with corners of a quadrilateral re- 
gion would render the gradient substantially; 



SB 



define a bi-cubic patch enclosing the region, 
the bi-cubic patch including four corners having 
a color associated therewith and four curves 
connecting pairs of the comers forming a 
closed loop, the four curves defining the color 
gradient across the bi-cubic patch as a function 
of the four colors associated with the four cor- 
ners of the bi-cubic patch; 
define a unit square in parameter space includ- 
ing a mapping function from the unit square to 
the bi-cubic patch such that the comers of the 
bi-cubic patch map to the comers of the unit 
square and wherein the color of eveiy point in 
the unit square is a bi-cubic interpolation of the 
four colors associated with the four corners of 
the bi-cubic patch; and 

clip the bi-cubic patch for display of the region. 

18 A computer program, tangibly stored on a compu- 
ter-readable medium, comprising instructions for 
causing a computer to: 

define a bi-cubic patch enclosing the second re- 
gion the bi-cubic patch including four comers 
having a color associated therewith and four 
cun/es connecting pairs of the corners forming 
a closed loop, the four curves defining the color 
gradient across the bi-cubic patch as a function 
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of the four colors associated with the four cor- 
ners of the bi-cubic patch; 
define a unit square in parameter space includ- 
ing a mapping function from the unit square to 
the bi-cubic patch such that the corners of the 
bi-cubic patch map to the corners of the unit 
square and wherein the color of every point in 
the unit square is a bi-cubic interpolation of the 
four colors associated with the four comers of 
the bi-cubic patch; and 

manipulate one or more of the curves in the bi- 
cubic patch until the color gradient of the sec- 
ond region visually approximates a color gradi- 
ent of the first region. 

19. A computer program, tangibly stored on a compu- 
ter-readable medium, comprising instructions for 
causing a computer to: 

subdivide the bi-cubic patch into sub-patches 
until each side of a given sub-patch is a good 
approximation of a line: 

check to determine if for all points inside of a 
given sub-patch if the color associated with 
each point is sufficiently accurate and, if not, 
further subdividing the sub-patch until the color 
associated with each point inside a given sub- 
patch is sufficiently accurate; 
divide the sub-patches into polygons; and 
render the polygons 



the bi-cubic patch to change the gradient; and 
display the bi-cubic patch interactively to the 
user. 

5 22. A computer program, tangibly stored on a compu- 
ter-readable medium, comprising instructions for 
causing a computer to: 

subdivide the bi-cubic patch into sub-patches 
10 until each side of a sub-patch is a good approx- 

imation of a line, then subdividing further until 
the interpolation within the sub-patch is linear 
within a specified tolerance; 
subdivide the sub-patch into polygons; and 
15 render the polygons. 

23. A computer program, tangibly stored on a compu- 
ter-readable medium, comprising instructions for 
causing a computer to: 

20 

subdivide a gradient into quadrilateral regions 
in which a bilinear interpolation of colors asso- 
ciated with corners of a quadrilateral region 
would render the gradient substantially; and 
25 subdivide each quadrilateral so that Gouraud 

shading provides an accurate shading result 
within a specified tolerance. 

24, A computer program, tangibly stored on a compu- 
30 ter-readable medium, comprising instructions for 

causing a computer to: 

define a non-linear color function; 
subdivide the color gradient into Gouraud shad- 
ed triangles, each triangle having a parameter 
associated with each vertex; 
use Gouraud-shading to linearly interpolate the 
parameter across a respective triangle; 
at each point on the triangle, use an interpolat- 
ed parameter to evaluate the non-linear color 
function which provides a color value. 



20. A computer program, tangibly stored on a compu- 
ter-readable medium comprising instructions for 
causinq a computer to. 

dctino a parametric bi-cubic patch covering a 
region to be shaded, each patch including four 
comers and lour parametric cubic curves in a 
closed loop joining the four corners, each cor- 
ner hHvmg a corner color: 
perform H l:ilinear interpolation on the corner 
colors to map an interpolated color to every lo- 
cation on the parametric bi-cubic patch. 

21. A computer program, tangibly stored on a compu- 
ter-readable medium, comprising instructions for 
causing a computer to: 

define « prttametiic bi-cubic patch covering a 
region to be shaded, each patch including four 
corners and four parametric cubic cun/es in a 
closed loop joining the four corners, each cor- 
ner having a comer color; 
perform a bilinear interpolation on the corner 
colors to map an interpolated color to every lo- 
cation on the parametric bi-cubic patch thereby 
defining a gradient: 

manipulate one or more of the cubic cun/es in 
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(57) A method tor defining a color gradient across a 
region in a display space that includes defining a bi-cu- 
bic patch enclosing the region. The bi-cubic patch in- 
cludes tour corners having a color associated therewith 
and four curves connecting pairs of the comers forming 
a closed loop The four curves define the color gradient 
across the bi-cub.c patch as a function of the four colors 
associated with the tour corners of the bi-cubic patch. 
The method includes defining a unit square in parameter 
space including a mapping function from the unit square 
to the bi-cubic patch such that the comers of the bi-cubic 
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of every point in the unit square is a bi-cubic interpola- 
tion of the four colors associated with the four comers 
of the bi-cubic patch. The method includes clipping the 
bi-cubic patch for display of the region. In another as- 
pect the invention provides a method of accurately ren- 
dering color gradients across a bi-cubic patch that in- 
cludes subdividing the bi-cubic patch into sub-patches 
until each side of a given sub-patch is a good approxi- 
mation of a line and checking to determine if for all points 
inside of a given sub-patch the color associated with 
each point is sufficiently accurate. It not. the sub-patch 
is further subdivided until the color associated with each 
point inside a given sub-patch is sufficiently accurate. 
The method includes dividing the sub-patches into pol- 
ygons and rendering the polygons. 
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